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(54) Image processing apparatus and method 



(57) An image processing apparatus is constructed 
by a setting circuit for manually setting a first color 
processing parameter, a first color processing circuit for 
performing a first color process by using the first color 
processing parameter, a storing circuit for storing a sec- 
ond color processing parameter set in correspondence 



to the first color processing parameter as a reference 
value, and a second color processing circuit for perform- 
ing a second color process different from the first color 
process by using the second color processing parame- 
ter, wherein in case of making the second color process- 
ing circuit function, the first color processing parameter 
is set to the reference value. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

The invention relates to image processing apparatus and method for performing a color process. 
Related Background Art 

In recent years problems such that various color reconstructions are performed due to a difference of a coloring 
mechan^ of eve^ inpultput device or a difference of a colomg material to be used because of a spread of networks 
a^ran^rqement of a demand for a color product and that a cotor matching function differs every kind of apparatus 
l^oSZ^l There is a color management system (CMS) as a technique which is highlighted to solve those 
oroblems MCsen. to sofve the problems, a process for matching the colors of input and output images by connecting 
m"n^ T< Tmp^d performing a L conversion using profile data formed every input/output equipment 

by tr r : a ^s« ie «*, > not « due to . 

Therefore ntormation regarding characteristics of input/output signals in input/output equipment which was set n a 
Lfe ence sS o der to suppress the characteristics of each device has been stored in the profile data. Inputotpu, 
chaLcterists o, , he signal oMhe device are distinct by the profile data o, each device and by correcting by using the 

P ^he1a,^ 

regJding fnpurequi'ment has been stored in input equipment profile data 101. Device characteristics data regarding 

eoulem p Xdata 101 . The converted data is a color signat which doesnl depend ,n each dev.ce. In ("^ another 
!SrSl12, the data is converted into a color sig nal su itable for each output egu gmer^in^e 
output equipment profile data 107 and is outputted by using such a color signa 

At present input/output equipment such as monitor, printer, scanner, or the like which is most frequently used has 
a h^T^L, the color or brightness in accordance with a taste of the user. The monitor generally has a knob 
S the b »s and contrast. To obtain a preferable image in operation of a fatigue o. *• 1* user 
^k^ebriZess of the monitor by freely moving the knob. In a monitor which can perform a further advanced 
corr^a o^^^^^^^ 

* a mannTsimilar to the above, ther^iis^rirUe^^ to cbtein a des.red color of 

ihP user bv a method such that an output balance of colors is adjusted, an LUT is formed, or the like. 

^S^SS^SL input/output equipment which can be adjusted by the user is usee I, mere .occur. a 
oroblem such that by the execution of the adjustment by the use,, a state of the input/output equipment when the prof e 

to an illumination light, namely, a color managing technique which has been proposed ,n recent years^ 

A COTStruction in he case where an image of an original is read by an image scanner and the read image s 
dispfayTd on a L or screenj^anamb^^ *ow. a £?£* 

co^X^fSiig'ra'm An image scanner t^Treads out the image of the original and outputs the read mage 
dlna R G B)t m A scanner color converse device 12 converts an output signal of an RGB ^ n £ 
J,, 1( T into a standard colorimetric systemfXYZcglor^^ reference to a scanner 

^oTife 14 which has previously been formed from image reading characteristics of the image scanner 10. 

A signal conversion device 16 corrects an output of the conversion device 1 2 in consideration da^b^gb^ 

po nents or a color distribution of the ambientjight. ..,■.„,„ m „ ni ,„r riiwiav (hereinafter 

in accordance with a monitorTrolilelsl^ich reflects coloring characteristics of a rnonitor d splay j h ^ e '" a "^ 
abb ovXd to a monitor) 24 to be used, a monitor color conversion device 20 converts the outpu signa * the XYZ 
colorimetric system of the signal conversion device 16 into values of an RGB space ,n consideration oMhejcJonna 
; characteristics of the monitor 24 and supplies to the monitor 24. 

^.^n ^nt wherethe image is observed will .iowbe simply explained w„n r™™»^ * * ' P ™^f/^ 
is read'bTthilnTage scanner 10 and the read image is displayed as an image (original .mage) on the screen o the 
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\ The ambient light sensor 18 is put onto the monitor 24 r a printer 30, or a computer main body and detects a color 
distribution or color components of the ambient light . The original image is generally displayed on the screen of the 
monitor 24 so as to be overlaid to a background color (color of the screen). Therefore, the user simultaneously looks 
at both of the background color and the original image and recognizes the color of the original image. 
5 The ambient light changes depending on a situation. According to the existing color managing technique, the 

arobienUiohLis .detected by the ambientJ iohLs enso r 18 and, in accordance with the detection intorrnatio rL-the-Signal 
conversion device 16 corrects an output of the scanner c olot_ conversion_devic e 12, namely, the color signal of the 
standard colorimetric system. Thus, the coloring of the original image which is displayed on the screen of the monitor 
24 is adjusted in accordance with the ambient light. Namely, a colorimetrolo g ical coincidence is realized. 

Although the colors of the same value on the standard color space inherently ought to be seen as a same color, 
in the case where both colors are a color of the monitor (light source color) and a color of the printed matter (object 
^^cpjoj) and even if they have the same value on the standard color space, they c annot be seen as a same color for the 
human eyes due to a difference of the visual environment, mode, or the like. As for such a problem, the following 
correcting techniques have also been proposed in order to enable the human being to perceive them as a same color 
^yjQ bserving with the eyes. 

It is considered that when observing colors, the human being uses white as a reference and recognizes all of the 
^olors-b y comp arin g with white. It is now considered a case, as an example, of observing a monitor display image put 
jjnd er a certain ambient light and a printed matter put under the same or a different ambient li ghL There are a number 
of white colors which should be reference colors such as white of the monitor scree n, white of the environmental light, 
white of a paper il luminated by the environmental ligh t, and the like. It is possible to regard such that the colors are 
observed by using a white color adapted to such a number of white colors at a certain ratio as a reference . A method 
whereby by calculatin g reference white and conver ting the colors of all of the image by setting such white as a reference, 
observation colors are mutually matched is considered. Actually, when reference white is calculated, one adaptation 
ratio of white of the monitor screen under the fluorescent light to the ambient light is determined and reference white 
25 i s calculated by using such an adaptation ratio. 

As shown in Fig. 8, when observing the original image which is displayed on thescjserLolthe,monitor.24 t .both-of- 
t he ori g inal ima g e and the ambient color (back g round color) simultaneously enter the e yes. Since the human being 
recognizes the color by a comparison with the circumstances, it has been known that if the colors displayed in the 
center portion are the same and the background colors are different, the colors of different impressions are perceived. 
30 Therefore, even in case of displaying the same image, if the background color differs, the color of the display image 
is recognized as a different color. 

SUMMARY OF THE INVENTION 

The invention is made in consideration of the above points and it is a concern of the invention to realize a highly- 
accurate color matching. 

Particularly, a concern of the invention is to enable an effect of a preset color process to be most efficiently derived. 
According to the invention, there is provided an image processing apparatus comprising: setting means for man- 
ually setting a first color processin g paramet er; first color processing means for performin g a first color process b y_ 
using the first color processing paramete r; storing means for storing a second color processing parameter which has 
been set in correspondence to the first color processing parameter as a reference value; and second color processing 
means for performing a second color process different from the first color process by using the second color processing 
parameter, wherein when the second color processing means is made function, the first color processing parameter 
is set to the reference value. ■ 

Another concern of the invention is to provide a highly -accurate color matching on the basis of an application of 
the user. 

According to another aspect of the invention, there is provided an image processing apparatus having first and 
second color matching modes (or performing different color matching processes, comprising: selecting means for se- 
lecting the color matching mode on the basis of an instruction of the user; and setting means for setting a background 
color on a display screen to a predetermined color when the second color matching mode is selected by the selecting 
means. 

The above and other features of the present invention will become apparent from the following detailed description 
and the appended claims with reference to the accompanying drawings. 

ss BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram regarding an image processing apparatus according to the embodiment 1; 
Fig. 2 is a flowchart for image processes according to the embodiment 1 ; 
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Fig. 3 is a constructional diagram of an image processing system according to the embodiment 2; 

Fig. 4 is a block diagram showing an example of an image processing system according to a modification of the 

embodiment 1; 

Fig. 5 is a block diagram showing an example of an image processing system according to a modification of the 
embodiment 1 ; 

Fig. 6 is a flowchart for image processes according to the embodiment 2; 

Fig. 7 is a schematic constructional block diagram of an image processing apparatus according to the embodiment 

3, 

Fig. 8 is a schematic diagram showing an arrangement of blocks in the embodiment shown in Fig. 7; 
Fig. 9 is a schematic constructional block diagram in a signal conversion device 1 6; 

Fig. 10 is a schematic diagram showing the relations among an ambient light, white and a background color of a 
monitor, and reference white; 

Fig. 11 is a schematic constructional block diagram of a modification; 

Fig. 12 is an operating flowchart for the modification shown in Fig. 11; 

Fig. 13 is a block diagram of an image processing apparatus according to a prior art; 

Fig. 1 4 is a schematic constructional block diagram of the prior art; and 

Fig. 15 is a diagram for explaining a general use environment. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Embodiments according to the invention will now be described hereinbelow with reference to the drawings. 
[Embodiment 1] 



The embodiment 1 relates to an example when the invention is applied to an image processing apparatus having 
an input unit, an output unit, and a color matching processing function. 

According to a color matching process, a data conversion is executed so as to equalize a color reconstruction 
irrespective of a device on the basis of input/output profiles showing inpuVoutput characteristics which are different 
every input/output device. 

Fig. 1 shows a block diagram of the image processing apparatus according to the embodiment 1 . 

Information regarding characteristics of inpuVoutput signals in each input/output device which was set into a ref- 
erence state has been stored in profile data of the input unit and output unit. 

Further, a parameter regarding the reference state of an input unit 104 at the time of formation of the input unit 
profile is added as a reference parameter 1 02 to the input equipment profile data. Similarly, a reference parameter 1 08 
at the time of the formation of an output equipment profile is added to the output equipment profile data. For example, 
in case of a monitor which is used as input/output equipment, parameters regarding the image adjustment such as 
gamma characteristics, contrast, brightness, color temperature of white, and the like have been stored in the reference 
parameter. 

As an example of a method of forming the profile data, in case of a printer, first, the apparatus is set into a reference 
state and a reference sample in which a certain input signal has already been known is outputted and color charac- 
teristics of the outputted sample are measured. The relation of the input/output signals is stored as profile data. 

Device characteristics data regarding the input unit 104 has been stored in the input equipment profile data 101 
Device characteristics data regarding an output unit 110 has been stored in the output equipment profile data 107. 

User adjustment parameter storage units 103 and 109 exist in the input/output units and parameters regarding 
the image adjustment including values which were freely set by the user by using knobs, menu bars and the like 
provided for a user adjustment unit 105 and output parameter adjustment unit 111 have been stored in the storaqe 
units 103 and 109. 

When the input unit or output unit is solely used without using a CMS software, ordinarily, an image is inputted or 
outputted by using the parameters stored in the user adjustment parameter storage units. 

However, when the color matching process is executed, in order to realize a color reconstruction of a high quality, 
it is necessary to set into a reference state when each profile data is formed. 

Namely, it is necessary to set the parameters of the input/output units in correspondence to the input/output profile 
data. 

For this purpose, which one of the user adjustment parameter 103 and the reference parameter 102 at the time 
of the formation of the input equipment profile should be used needs to be decided by a color matching processing 
condition setting unit 124 in accordance with the input/output environment of the image. 

A flow of processes according to the embodiment 1 will now be described hereinbelow with reference to Fig. 2. 

First, whether the color matching process is executed or not is set by the color matching processing condition 
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setting unit 124 in a console unit 125 (S10). 

When the cobr matching process is executed, the processing parameters in the input unit 104 and output unit 110 
are set to the reference values when the profiles are formed (S20). 

An inputting process is executed on the basis of the reference values set in the input unit 104, thereby obtaining 
5 input image data (S30). 

As mentioned above even if the user adjustment parameters are used, in case of matching the colors of input and 
output images by using the color matching process, the reference parameter 102 which has previously been added to 
the input equipment profile data is used in place of the user adjustment parameter 103. At this time, the user adjustment 
parameters are rewritten and the control of the input unit can be performed or the control of the input unit can be also 
io directly performed by using the reference parameter irrespective of the user adjustment parameters. As mentioned 
above, the input image data is obtained by the input equipment set in the reference state. 

In the data conversion unit 106. the input image data is subjected to a data conversion process 1 for converting 
into data (device independent signal) which doesnl depend on the device on the basis of the input equipment profile 
data 101 (S40). 

is in the data conversion unit 11 2, a data conversion process 2 for converting into output image data suitable for an 

output device is executed on the basis ot the output equipment profile data 107 (S50). 

Namely, in the data conversion process 1 , the input image data depending on the input unit is converted into the 
device independent data by using the input equipment profile data. In the data conversion process 2, the device inde- 
pendent data is converted into output image data which depends on the output unit by using the output equipment 

20 profile data. 

In a manner similar to the input unit, even if the user adjustment parameters have been set, in case of matching 
the colors of the input and output images by using the color matching process, the reference parameter 108 which has 
previously been added to the output equipment profile data and has been set in step S20 is used in place of the user 
adjustment parameters 109, thereby obtaining output image data from the output unit 110 set in the reference state. 
25 On the other hand, when a mode such that the color matching process is not executed is set in step S10, the 

parameters of the input unit and output unit are arbitrarily manually set in accordance with an application of the user 
by using the user adjustment unit 105 and output parameter adjustment unit 111 of a console unit 25 (S70). 

When the parameters of the input unit and output unit have been preset in accordance with the application of the 
user, those parameters can be also used. 
30 An input process is executed in the input unit and an output process is executed in the outpul unit in accordance 

with the set parameters {S80 and S90). 

Each unit of the image processing apparatus is controlled by a CPU 121 connected through a CPU bus 120. 
The CPU 121 controls each of the above units by using an RAM 123, as a work memory, on the basis of, for 
example, a program to execute processes shown in Fig. 2 stored in an ROM 1 22 in accordance with the setting of the 
35 console unit 125. 

According to the embodiment 1 , when the color matching process is executed, since the input and output processes 
are executed in the input/output units by the parameters suitable for the input/output equipment profiles which are used 
for the color matching processes which are executed by the data conversion units 106 and 112, an effect of the CMS 
process can be most efficiently derived. 
40 That is, the colors can be matched irrespective of the input/output devices. 

When the color matching process is not executed, an arbitrary process can be performed on the basis of a will of 
the user. 

[Modification 1] 

45 

As a modification, an example in which the invention is applied to an image processing system as shown in Fig. 
3 will now be described. 

The image processing system is constructed by: 
input equipment 204 and output equipment 205 corresponding to the input unit 104 and output unit 105 in the embod- 
50 iment 1 ; and a computer 200 for performing the color matching process. 

An example in the case where the user adjustment parameters exist in a memory of the computer for controlling 
instead of the input/output equipment will now be described hereinbelow with reference to Fig. 4. 

Portions similar to those in the embodiment 1 are designated by the same reference numerals. 

In a manner similar to the embodiment 1, when an image is inputted, whether the user adjustment parameters 
os 103 are used or Ihe parat neters -are 'sei'to the reference parameter 102 when each profile is formed is first determined 
in accordance with input/output environment of the image. Both of the user adjustment parameters and the reference 
parameter have been stored in the memory of the computer for controlling. When the colors of the input and output 
images are matched by a CMS (color management system) software, in a parameter selection unit 301 , the reference 
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parameter 102 added to the input equipment profile data is selected. On the basis of the selected parameter the input 
equipment is set mto the reference state by an input equipment control unit 302. In the other case where the CMS 
software is not used, the user adjustment parameters 103 adjusted by the user are selected and the input equipment 
204 is controlled by using the user adjustment parameters. Image data is obtained by such input equipment 

Even in the data conversion, a conversion similar to that in the embodiment 1 is executed. The control of the output 
equipment is also substantially the same as that for the input equipment. Either one of the user adjustment parameters 
109 and reference parameter 108 is selected in accordance with the input/output environment of the image An output 
image is derived from output equipment 210 controlled by using the selected parameter. 

In the image processing system shown in Fig. 3 : the reference parameter has been added to the input/output 
equipment profile data. However, as shown in Fig. 5, both of the user adjustment parameters 103 and 109 and the 
reference parameters 102 and 108 can be also stored into parameter storage units 401 and 402 of the input/output 
equipment by disconnecting from the input/output equipment profile data, respectively. It is also possible to arbitrarily 
select both of them in accordance with the input/output environment and to obtain an image by the inpuVoutput equip- 
ment controlled by the selected data. w p 

Although ihe storing locations of the data have been limited in the above embodiment, the invention is not limited 
to the example as shown in the embodiment but the invention can be also sufficiently applied to a combination of them 
or a case where the storing positions of the user adjustment parameters and reference parameter are other than the 
locations mentioned in the embodiment. 

That is, the user adjustment parameters can be also stored into input/output equipment main bodies. 

[Embodiment 2] 

In the foregoing embodiment 1, when the color matching processing mode is set, the user cannot set a user 
processing parameter. 

Therefore, for example, when the user wants to finely adjust the image generated by the color matching process 
the user has to set an ordinary mode in which the color matching process is not executed and to set parameters from 
the beginning. 

In the embodiment 2, an example in which an image can be finely adjusted for a color matching processing result 
will now be described with reference to Fig. 6. 

In Fig. 6, substantially the same processing steps as those in the embodiment 1 are designated by the same 
processing step numbers and their descriptions are omitted. 

In Fig. 6, processes in steps S110 to S160 are added to the processes in the embodiment 1 in order to perform 
the fine adjustment mentioned above. 

When the CMS processing mode is set in step S20, the color matching process (S10 to S50) is executed in a 
manner similar to the embodiment 1 and the image data which was color matching processed is stored into the RAM 

An image is outputted by using the reference parameter by the output unit 110. 
Whether the output image is satisfactory or not is confirmed by the eyes (S120). 
When the user satisfies the output image, the processing routine is finished. 

On the other hand, when the user cannot satisfy the output image, in order to perform the fine adjustment the 
parameters of the output unit are set by using the output parameter adjustment unit 11 1 (S1 30) 

The image data which was CMS processed and stored in the RAM 123 is read out and an image is outputted bv 
using the set parameters (S 140). y 

The processes in steps S120 to S140 are repeated until a satisfactory output image can be obtained 

Each of the above embodiments has been shown and described on the assumption that, as for the selection 
between the user adjustment parameters and the reference parameter, when the color of the image is controlled by 
the CMS software, the reference parameter is selected and, in the other cases, the user adjustment parameters are 
used. However, it is also possible to automalicaliy select the parameters or to arbitrarily select either one of those 
parameters in accordance with a desire of the user case by case. 

Further, although the case where the number of reference parameters when the profile is formed is set to one 
parameter has been shown above, it is also possible to construct in a manner such that there are a plurality of reference 
parameters corresponding to the user adjustment values and a reference parameter at the time of control is newly 
formed ac interpolation data-of them. 

Although the embodiments have been described above with respect to the inpuVoutput equipment the invention 
can be also applied to any other various combinations such as (scanner .and monitor), (monitor .and printer), and the 
like as a combination of the input/output equipment. 
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[Embodiment 3] 

The embodiment 3 of the invention will now be described in detail hereinbelow with reference to the drawings. 

The embodiment 3ol the invention applied to a copying apparatus with a monitor for displaying an original image 
5 and a previewer having functions for a selection ol an output portion, an edition of a color, and the like on a monitor 
screen will now be described. Fig. 7 shows a schematic constructional block diagram of such a copying apparatus. 
Fig. 8 shows a schematic block diagram showing an arrangement of functional blocks in Fig. 7. The same component 
elements in Figs. 7 and 8 are designated by the same reference numerals. 

An image of an original is read by the image scanner 10. The image scanner 10 outputs the read image data as 
10 an RGB signal. The scanner color conversion device 12 converts the output signal of the RGB colorimetric system 
(color system) of the scanner 10 into the values of the XYZ colorimetric system in consideration of the reading char- 
acteristics of the image scanner 10 in accordance with the scanner profile 1 4 which has been prepared in accordance 
with the reading characteristics of the image scanner 10. An output of the color conversion device 12 is a standard 
color signal which doesnt depend on the image input device. It will be obviously understood that the standard color 
is space is not limited to the XYZ colorimetric system and another arbitrary colorimetric system can be used so long as 
it can absorb a device dependence. 

Data regarding the color characteristics of the scanner 10 has been stored in the scanner profile 14. Specifically 
speaking, a color conversion matrix from RGB to XYZ or a lookup table (LUT) has been stored. 

The signal conversion device 16 corrects an output of the conversion device 12 in accordance with ambient color 
20 information which is supplied from the ambient light sensor 18 for detecting color components or a color distribution 
of the ambient light and white information and information of a background color of the monitor 24 to display the read 
image. In the embodiment, the white information and the information of the background color of the monitor 24 are 
supplied from the monitor profile 22 having the coloring characteristics of the monitor 24. 

In accordance with the coloring characteristics information from the monitor profile 22, the monitor color conversion 
2S device 20 converts the output signal of the XYZ colorimetric system of the signal conversion device 16 into the RGB ; - 
values in consideration of the coloring characteristics of the monitor 24 and supplies to the monitor 24. The monitor 
24 displays the image of the original as a preview image. 

Data regarding the coloring characteristics of the monitor 24, specifically speaking, a color temperature and a light 
emission luminance of the monitor 24, a chromaticity value of a fluorescent material, color conversion information from 
so the standard color space to the device dependence color signal, and the like have been stored in the monitor profile 
22. The monitor background color information which is supplied from the monitor profile 22 to the signal conversion 
device 16 includes background color information which is at present displayed by the monitor 24 and the background 
color information when the monitor profile 22 is formed. 

In accordance with the characteristics information from a printer profile 28 having coloring characteristics of the 
35 printer 30, the printer color conversion device 26 converts the output signal of the XYZ colorimetric system of the signal 
conversion device 16 into CMYK signal in consideration of the coloring characteristics of the printer 30 and supplies 
to the printer 30. The printer 30 prints and outputs the image of the original onto a recording paper in accordance with 
the color signal from a color conversion device 26. 

As shown in Fig. 8, the scanner color conversion device 1 2 is enclosed in a scanner unit 32. The signal conversion 
40 device 16, monitor color conversion device 20, printer color conversion device 26, and printer 30 are enclosed in a 
printer unit 34. The monitor 24 is put on an upper portion of the scanner unit 32. The ambient light sensor 1 8 is arranged 
beside the monitor 24. 

Fig. 9 shows a schematic constructional block diagram in the signal conversion device 16. Adaptation ratios cor- 
responding to one or two or more environments which are presumed in the case where the ambient light is a prede- 

45 termined standard light source (A, C, D93, D65, D50, F, etc.) have been stored in an adaptation ratio storage 40. An 
adaptation ratio also corresponding to a background color (for example, gray scale) when an image is seen has also 
been stored in the adaptation ratio storage 40. An adaptation ratio determination device 42 selects the adaptation 
ratios corresponding to the present ambient light and the background color of the monitor from the adaptation ratio 
storage 40 in accordance with the ambient light information from the ambient light sensor 18 and the monitor white 

so information and the monitor background color information from the monitor profile 22 and supplies to a reference white 
calculation device 44. 

The reference white calculation device 44 calculates reference white suitable for the ambient light and an obser- 
vation environment such as color temperature, background color, and the like of the monitor 24 in accordance with the 
adaptation ratios from the adaptation ratio determination device 42, the ambient light information from the ambient light 
'55 sensor 1 8, arid the monitor white information and monftor'background color information from the monitor profile 22. Its 
calculating method will be described in detail hereinlater. 

An image conversion device 46 converts signals (Xi, Yi, Zi) from the scanner color conversion device 12 in ac- 
cordance with reference white (Xw, Yw, Zw, xw, yw) calculated by the reference white calculation device 44 and gen- 
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erates signals (Xo, Yo, Zo) of the XYZ colorimetric system. 

Fig. 10 is a schematic diagram showing the relations among the ambient light, white and background color of the 
monitor, and reference white. The ambient light is based on the reference light source. Fig. 10 shows reference white 
colors as an example with respect to two background colors. An output of the ambient light sensor 1 8 can be any one 
of the spectral data, color signals of XYZ, RGB, or the like, and manual input of those color signals In Fig 10 the 
ambient light information is shown as a reference light source W. The monitor white information from the monitor profile 
22 is the color temperature, luminance value, chromaticity value, etc. and is shown as a monitor white point V in Fig 1 0 

As described above, when observing the image which is displayed on the monitor screen, it is considered that the 
human being isn't perfectly adaptive to only monitor white but is adaptive to both of monitor white and the ambient liqht 
at a certain ratio. As shown in Fig. 10, therefore, reference white serving as a color observing reference is located 
between monitor white and the ambient light (reference light source). It is now assumed that an adaptation ratio to 
monitor white is set to s, an adaptation ratio to the ambient light is set to 1-s, the ambient light information which is 
obtained from the ambient light sensor 18 is set to Wx, Wy, Wz, wx and wy, monitor white signals which are obtained 
from the monitor profile 22 are set to Vx, Vy, Vz, vx, and vy, and reference white signals to be calculated are set to Xw 
Yw, Zw, xw, and yw, respectively. Thus, Xw, Yw, Zw, xw, and yw can be calculated by the following equations (1 ) and 
(2). Namely, with regard to three stimulus values, 



Xw = (l-s)°Wx + s»Vx 
Yw = (l-s)°Wy + s°Vy 
Zw = (l-s)°Wz + s°Vz 



(1) 



With regard to the chromaticity values, 



xw = (1-s)°wx + s°vx 
yw = (1-s)°wy + s n vy 



(2) 



Since s depends on the ambient light at the time of the image observation and the background color of the monitor 
24, the adaptation ratio (s : 1-s) changes depending on the ambient light and the background color of the image In 
association with it, the reference white point also changes every ambient light and background color For example 
when the background color is changed from black to white at a gray scale level, as the background color approaches 
black, the adaptation ratio to the ambient light increases irrespective of the color temperature of the monitor 24 and 
ambient light. 

It is, therefore, necessary to decide the adaptation ratio in accordance with not only the ambient light but also the 
background color to be observed. In the embodiment, by deciding as mentioned above, the optimum reference white 
point rs calculated. 

A method of converting the whole image on the basis of the reference white signal calculated in this manner will 
now be described. 

The image which is displayed on the monitor screen is observed on the basis of reference white calculated as 
mentioned above. On the other hand, the printed matter is adaptive to white of the paper or white of the ambient liqht 
is now assumed that the reference white is set to Xw, Yw, and Zw, white of the ambient light is set to Wx Wy, and 
Wz, the image signals (input signals of the image conversion device) which are inputted from the scanner color con- 
version device 12 to the signal conversion device 16 are set to Xi, Yi, and Zi, and the image signals which are outputted 
from the image conversion device 46 of the signal converting apparatus are set to Xo, Yo, and Zo The following 
equation (3) as a modification of Von Kreis's equation is satisfied Namely 



Xo / Xw ' 




'XJ/wx' 


Yo /Yw 




Yi / Wy 


Zo /Zw 




.Zi / Wz . 



... (3) 



a 
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By modifying the equation (3), the following equation (4) is obtained. 



JO 



15 



20 



Xo 




Xi 




'Xw /WX' 




Yo 




Yi 




Yw /Wy 


... (4) 






,Zi, 




,Zw / Wz. 





The following equation (5) can be also used by also including the contrast conversion of the image in consideration 
of the visual sense characteristics of the human being into the equation (4). Namely, 



Xo / Xw 
Yo / Yw 
7.0 / Zw j 



Xi / Wx 
Yi /Wy 
12 /Wz J 



... (5) 



25 



By modifying the equation (5), 





f N 

Xo 




'Xi 


/ Wx' 


Y 


'Xw' 


30 


Yo 




Yi 


/ Wy 




Yw 




,20 , 




,2 


/ Wz , 




,2w. 



... (6) 
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The monitor color conversion device 20 converts the image signals Xo, Yo ( and Zo obtained as mentioned above 
from the XYZ colorimetric system to the RGB colorimetric system in accordance with the conversion information from 
the monitor profile 22. 

By such a color matching process, color tones of a source image and an output image can be matched. Particularly, 
by obtaining the reference white signal also in consideration of the background color, a good color matching process 
can be performed. 

In the above embodiment, when the adaptation ratio (s : 1 -s) or s is decided, the adaptation ratio has been changed 
in accordance with both of the ambient light and the background color. However, the adaptation ratio can be also set 
in accordance with the observation environment such as color temperature of the monitor, reflected light from the 
monitor, or the like. 

Fig. 11 shows a schematic constructional block diagram of a modification of the above embodiment. In the modi- 
fication, the user can select the setting of a color process. Specifically speaking, in case of performing the color process 
at a high precision, a predetermined background color is displayed on the monitor 24 and both of the display image 
and the background color, namely, the whole screen of the monitor 24 is controlled, thereby more accurately matching 
the original image to be displayed on the monitor 24 and the original image which is seen. Reference numeral 50 
denotes a color processing setting device to set a color processing method. There are a mode to use the present 
background cclor of the monitor 24 as it is and a mode to 'display a specific background color which has previously 
been selected. The user selects the latter mode when he wants to perform a color management at a high accuracy. 

Fig. 12 shows a flowchart of a main operation portion of the modification shown in Fig. 1.1. 

By the color processing setting device 50, the user sets the color processing method (color matching mode) to be 
executed by the signal conversion device 16 in accordance with an application (S1). It can be set by a menu bar or 
the like or can be also selected by pushing a button. Further, it is also possible to determine the default in a manner 
such that the color managing process as described in the embodiment shown in Fig. 7 is performed and a highly- 
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accurate color management is executed in the other cases. 

In case of the highly-accurate color management (SI), the background color of the screen of the monitor 24 is set 
to a predetermined color (S5). In the case where the highly-accurate color management is not performed (in case of 
the ordinary color management) (Si), the present background color is maintained as it is. 

In order to perform the highly-accurate color management, it is necessary to control the background color There- 
fore, when a plurality of windows are opened on the same screen, the other windows are hidden by the background 
color. On the other hand, when the highly-accurate color management is not performed, processes can be executed 
in parallel with reference to the other windows. The user, accordingly, sets the color processing method on the basis 
of the application (whether a priority is given to the precision of the color matching or not) in step Si 

The subsequent process9s are substantially the same as those in the embodiment shown in Fig 7 The signal 
conversion device 1 6 sets the optimum adaptation ratio from the ambient light information from the ambient light sensor 
1 8, the monitor white information, and the background color of the monitor and converts the output signal of the scanner 
color conversion device 1 2 in accordance with the reference white signal that is decided on the basis of the adaptation 
ratio (S2). The monitor color conversion device 20 converts the output signal of the signal conversion device 18 from 
the XYZ colorimetric system to the RGB colorimetric system (S3). The output image signal of the monitor color con- 
version device 20 is displayed at a predetermined position on the screen of the monitor 24 (S4). 

In case of the highly-accurate color management, since the background color is a predetermined color, the color 
matching can be performed at a higher accuracy. As a background color in this case, for example, a background color 
which has been set in the environment at the time of the formation of the profile or a standard environment at the time 
of the color observation or a background color that is optimum to every environment has been prepared and the proper 
background color is selected among them in accordance with the present environment. 

In the modification shown in Fig. 11, the decided background color has been displayed only in case of selecting 
the highly-accurate color management process. However, it is also possible to enable whether the color management 
is performed or not to be selected and to automatically display the determined background color in case of executinq 
the color management. 

As for the background color of the monitor when the image is observed, the standard observing condition at the 
time of the formation of the profile can be determined and such information can be stored into the profile as mentioned 
above. However, in any case, it will be understood that when a luminance of the background color to be displayed on 
the monitor is lower than that of white in the observation image (white in the print original), it is more desirable in case 
of matching both of the colors. White in the observation image (white in the print original) is obtained from a reflectance 
of the paper which has previously been known and the light source information derived from the ambient light sensor 
18. When the luminance of white in the print image is equal to or less than the luminance of the highest output of the 
monitor, it is desirable to use the luminance of the background color having a value smaller than that of white in the 
observation image. 

For example, when the image is observed in an environment in which the luminance of white in the observation 
image and the highest luminance of the monitor are equal and, after that, the luminance of the ambient light of the 
room decreases, a phenomenon such that both of the colors cannot be matched because the background color of the 
monitor is too bright occurs. However, by setting the luminance of the monitor background color to be lower than that 
of white in the observation image, an environment in which the color matching is more available can be formed 

As means for obtaining the ambient light information, it is possible to detect the ambient light of the environment 
in which the image is at present observed by a sensor or to previously measure the ambient light by the user by using 
an illumination photometer, a luminance meter, or the like and to input the measured value to the signal conversion 
device 16. It is also possible to use a method whereby several selection items have already been made and a proper 
value that is closest to the present environment is selected among them. 

By calculating white in the observation image from the ambient light information obtained and the well-known 
reflectance of the paper and by changing the background color of the monitor so that the luminance of the background 
color is lower than that of such white, both of the colors can be matched. 

The invention is not limited to the above embodiment. For example, the invention can be applied to the color signal 
converses of various input/output equipment. Namely, the invention can be used in every image processing apparatus 
for performing the color signal conversion. 

It will be obviously understood that the monitor display is not limited to the CRT display but can also use a liquid 
crystal display. 

According to the embodiment 3 and its modification as described above, in the correction to match the light source 
color and the observation color of the object color, the reference white is calculated on the basis of not only the ambient 
light but also the background color in case of observing the image and the whole image is converted in accordance 
with the calculated reference white. Therefore, the observation color of the display image can be also matched to a 
different background color. 

By forcedly setting the background color to a predetermined color, the observation color can be more accurately 
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matched. 

By setting the luminance of the background color to be lower than that of white of the image (white in the print 
image), both of the colors can be matched. 

By performing the color temperature conversion by reference white suitable for the observation environment, the 
s color tones can be preferably matched. 

A highly-accurate color matching can be provided on the basis of an application of the user. 

<Other embodiments> 

10 The invention can be applied to a system constructed by a plurality of equipment (for example, a host computer, 

an interface equipment, a reader, a printer, or the like) or can be also applied to an apparatus comprising one equipment 
(for example, a copying apparatus or a facsimile apparatus). 

An invention embodied by a method whereby program codes of a software to realize the functions of the embod- 
iment are supplied to a computer in an apparatus or system connected to various devices so as to make the devices 

is operative in order to realize the functions of the foregoing embodiments and the various devices are operated in ac- 
cordance with the programs stored in the computer (CPU or MPU) of the system or apparatus is also included in the 
scope ol the invention. 

In such a case, the program codes themselves of the software realize the functions of the foregoing embodiments 
and the program codes themselves and means for supplying the program codes to the computer, for example, a memory 
20 medium in which the program codes have been stored construct the invention. 

As such a memory medium to store the program codes, for example, it is possible to use a floppy disk, a hard disk, 
an optical disk, a magnetooptic disk, a CD-ROM, a magnetic tape, a non-volatile memory card, an ROM, or the like 
can be used. 

It will be obviously understood that the program codes are included in the embodiments of the invention even in y 
25 not only a case where the functions of the foregoing embodiments are realized by executing the supplied program 

codes by the computer but also a case where the functions of the foregoing embodiments are realized in cooperation * 
with the OS (operating system) by which the program codes operate in the computer or another application software 
or the like. 4 
Further, it will be also obviously understood that the invention also incorporates a case where the supplied program 
30 codes are stored into a memory provided for a function expansion board of a computer or a function expansion unit 
connected to a computer and, after that, a CPU or the like provided for the function expansion board or function ex- 
pansion unit executes a part or all of the actual processes on the basis of instructions of the program codes, and the 
functions of the foregoing embodiments are realized by the processes. > 
Although the present invention has been described above with respect to the preferred embodiments, the invention 
35 is not limited to the foregoing embodiments but many modifications and variations are possible within the spirit and 
scope of the appended claims of the invention. 



Claims 

40 

1. An image processing apparatus comprising: 

setting means for manually setting a first color processing parameter; 

first color processing means for performing a first color process by using said first color processing parameter; 
45 storing means for storing a second color processing parameter set in correspondence to said first color 

processing parameter as a reference value; and 

second color processing means for performing a second color process different from said first color process 
by using said second color processing parameter, 

wherein in case of making said second color processing means function, said first color processing parameter 
50 is set to said reference value. 

2. An apparatus according to claim 1, whersinon the basis of characteristic of -an input unit or an output unit, said 
second color processing means executes said second color process by using said second color processing pa- 
rameter so as to reproduce an image at a high fidelity. 

55 

3. An apparatus according to claim 1 , further having resetting means for resetting said first color processing parameter 
corresponding to output means when an output image derived by said second color process cannot be satisfied, 
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and wherein said first color processing means executes said first color process to the image data which was 
subjected to said second color process on the basis of said reset first color processing parameter and 
said resetting process and the first color process based on said first color processing parameter set by said 
resetting means are repetitively executed until the output image can be satisfied. 

4. An apparatus according to claim 1 , wherein said storing means stores said second color processing parameter 
and said reference value so as to correspond to each other. 

5. An image processing apparatus having first and second color matching modes for performing different color match- 
ing processes, comprising; 

selecting means for selecting the color matching mode on the basis of an instruction of a user; and 

setting means for setting a background color on a display screen to a predetermined color when said second 

color matching mode is selected by said selecting means. 

6. An apparatus according to claim 5, further comprising: 

storing means for storing a profile according to said background color; and 

color matching processing means for performing the color matching process by using said profile. 

7. An apparatus according to claim 5, wherein in said color matching process, a color adapting process according to 
said background color and an illumination light to illuminate said display screen is executed. 

8. An image processing method comprising: 

a setting step of manually setting a first color processing parameter; 

a first color processing step of performing a first color process by using said first color processing parameter 
a storing step of storing a second color processing parameter set in correspondence to said first color process- 
ing parameter as a reference value; and 

a second color processing step of performing a second color process different from said first color process by 
using said second color processing parameter, 

wherein in case of making said second color processing means function, said first color processing parameter 
is set to said reference value. 

9. A recording medium to store programs to realize an image processing method comprising: 

a setting step of manually setting a first color processing parameter; 

a first color processing step of performing a first color process by using said first color processing parameter 
a storing step of storing a second color processing parameter set in correspondence to said first color process- 
ing parameter as a reference value; and 

a second color processing step of performing a second color process different from said first color process by 
using said second color processing parameter, 

wherein in case of making said second color processing means function, said first color processing parameter 
is set to said reference value. 

1 0. An image processing method having first and second color matching modes for performing different color matching 
processes, comprising: 

a selecting step of selecting the color matching mode on the basis of an instruction of a user; and 

a setting step of setting a background color on a display screen to a predetermined color when said second 

color matching mode is selected by said selecting step. 

1 1 . A recording medium to store programs to realize an image processing method having first and second color match- 
ing modes for performing different color matching processes, comprising: 

a selecting step of selecting the color matching mode on the basis of an instruction of a user- and 

a setting step of setting a background color on a display screen to a predetermined color when said second 

color matching mode is selected by said selecting step. 
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FIG. 2 
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FIG. 6 
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FIG. 8 
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FIG. 12 
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(54) Image processing apparatus and method 



(57) An image processing apparatus is'constructed 
by a setting circuit for manually setting a first color 
processing parameter, a first color processing circuit for 
performing a first color process by using the first color 
processing parameter, a storing circuit lor storing a sec- 
ond color processing parameter set in correspondence 



to the first color processing parameter as a reference 
value, and a second color processing circuit for perform- 
ing a second color process different from the first color 
process by using the second color processing parame- 
ter, wherein in case of making the second color process- 
ing circuit function, the first color processing parameter 
is set to the reference value. 



CO 
< 

CD 

o 

CL 
UJ 



FIG. 7 



101 



REFERENCE 
PARAMETER 



103 



INPUT UNIT 

PROFILE 

DATA 



CL. 

OUTPUT UNIT 

PROFILE 

DATA 



107 



108 



REFERENCE 
PARAMETER 



USER 

ADJUSTMENT 
PARAMETER 
STORAGE UNIT 



INPUT UNIT 



DATA 

CONVERSION 
UNIT 




DATA 

CONVERSION 
UNIT 









.109 





USER 






ADJUSTMENT 






PARAMETER 






STORAGE UNIT 




OUTPUT UNIT 



106 DEVICE INDEPENDENT SIGNAL 112 



110 



120 



CPU BUS 



CPU 




ROM 




RAM 


^121 


U 122 


s 



INPUT PARAMETER 
ADJUSTMENT UNIT 



OUTPUT PARAMETER 
ADJUSTMENT UNIT 



COLOR MATCHING PR0C 
CONDITION SETTING UNIT 



CONSOLE UNIT 




.105 
,124 



125 



EP 0 767 445 A3 



0 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP 96 30 7166 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Catcgtry 



Citation of doctimett with indication, where appropriate, 
ofrefcvitnl passages 



JOURNAL OF ELECTRONIC IMAGING, 

vol. 2, no. 3, July 1993, US, 

pages 213-224, XP000394880 

KANAMORI E.A.: "FAST COLOR PROCESSOR WITH 

PROGRAMMABLE INTERPOLATION BY SMALL MEMORY 

(PRISM) " 

* page 216, left-hand column, line 3 - 
line 31; figures 1,2 * 

* page 223, left-hand column, line 18 - 
line 42 * 

EP 0 565 283 A {SCITEX CORP LTD) 13 
October 1993 

* column 2, line 42 - column 3, line 24 * 

* column 11, line 52 - column 12, line 7 * 

* column 13, line 8 - column 14, line 12 * 

WO 94 30003 A (TALIGENT INC) 22 December 
1994 

* page 5, line 4 - line 13 * 

* page 35, line 1 - line 20; figure 9 * 

WO 91 10316 A (EASTMAN KODAK CO) 11 July 
1991 

* page 6, line 12 - page 7, line 27 * 

* page 10, line 20 - page 11, line 19 * 

US 5 349 452 A {MAEDA MASAHIRO ET AL) 2G 
September 1994 

* page 4, line 23 - page 5, line 21; 
figure 1 * 



The present search report kxs been drawn up for ail claims 



BERLIN 



18 February 1997 



Relevant 
to claim 



CLASSIFICATION OF THE 
APPLICATION (1nt.CL6) 



1-11 



G06T11/00 
G06T7/40 



1,2,4, 
8-11 



1-4,8-11 



TECHNICAL FIELDS 
SEARCHED 0nt.CU) 



1,2,4, 
8-11 



1,2,4, 
8-11 



H04N 



Burgaud, C 



CATEGORY OF CITED DOCUMENTS 

X :<pcrticKlarly yclevasi it taken tlone 

Y : pvticultrf> relevant if combined with mother 

document of the same category 
A : technological background 
O : no»- written disclosure 
P : inferniedjite document 



T : theory or principle underlying the invention 
F. : earlier patent document, bat published on, or 

irtcr the filing date 
D : document cited in the application 
I. : document cited for other reasons 

& : rtemttti the time patent faraiiy, correspofiijiog 
document 



